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TECHNICAL FIELD: 

This invention relates to techniques and systems to compute numerical solutions of linear systems of 
equations, and more specifically relates to implementing preconditioning of the coefficient matrix of 
such a system. 

BACKGROUND: 

Systems are known in the art for computing numerical solutions of linear systems of equations. Also 
known is the preconditioning of the coefficient matrix of such a system. 

Computer aided design (CAD) systems have become accepted universally as important engineering 
design tools for a variety of applications in mechanical, civil, and electrical engineering. Information 
regarding the shape and physical properties of a device or structure are captured and stored in the 
system in the form of a geometric model. The behavior of the physical system is described in 
mathematical terms, via the application of known laws of physics, as a problem whose solution 
reveals a property of the system that it is desired to evaluate. In practice, a region is divided into 
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elements, often tens of thousands or millions of elements, over which the properties are considered to 
vary in a known maimer and to which classical principles can be applied to yield a system of linear 
algebraic equations. 

The computational cost associated with evaluating the physical system is dominated by the solution 
of this system of equations. It is therefore of paramount technical importance to improve the 
computational efficiency with which the numerical solution to these equations can be generated. For 
this reason, iterative techniques are typically the method of choice for solving such linear systems 
due to their speed advantage over direct inversion methods. These methods, however, are strongly 
dependent of the condition number, i.e., the size of the span of the spectrum of the resulting matrix. 
It is known that large condition numbers reduce the convergence of the system dramatically. 

In order to overcome the convergence rate difficulties, matrix preconditioners are used to reduce the 
condition number. Solving linear systems using conjugate gradient (CG) iterative methods, for 
example, with preconditioning has been well documented and is summarized in "Numerical 
Recipes", W. Press et al., Cambridge Press (1992). The most common preconditioning method is 
known as incomplete LU, and is described in detail in "Iterative Solution Methods", O. Axelsson, 
Cambridge Press (1 994). To summarize, in a triangular (LU) factorization of a matrix A, the matrix 
is decomposed into a lower triangular matrix L and an upper triangular matrix U, thereby expressing 
the matrix as a product LIMA. If A is a sparse matrix, meaning the matrix has a low ratio of nonzero 
elements, the ratio of nonzero elements in the resulting matrices L and U is increased. The 
generation of nonzero elements is ordinarily called "fill-in". In the incomplete LU, the fill-in is 
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ignored by approximating it to zero. Alternatively, fill-in can be selectively ignored based on its 
relative magnitude. Modifications to the incomplete LU in generating preconditioned for sparse 
coefficient matrices are described in U.S. Patent No. 5,136,538, "Preconditioned Conjugate Gradient 
System", N.K. Karmardar et al., and in commonly assigned U.S. Patent No. : 5,754, 181, "Computer 
Aided Design System", V. Amdursky et al. 

The application of incomplete LU is limited to instances where the condition number is small, which 
is especially the case in the solution of dense matrices, such as those produced when attempting to 
solve integral equations. In order to apply an incomplete LU on a dense preconditioner, the 
preconditioner must first be "sparsed". For example, setting to zero all matrix elements whose 
magnitude is below a certain threshold, or setting to zero all elements in the preconditioner 
representing interactions between elements in the physical system separated by distances larger then 
a certain threshold. All known choices of sparsing the preconditioner , including the two mentioned 
above, when combined with incomplete, or even complete, LU factorization produce poor results 
when the condition number of A is large. Therefore, in order to overcome the convergence rate 
difficulty in general linear systems with large conditioner numbers, a general and robust 
preconditioning method is needed. Prior to this invention, this need was not adequately met. 

A particular problem arises during the electrical analysis of devices that are small with respect to 
the wavelength, such as electronic packaging structures, chips, interconnects, and printed circuit 
boards. The analysis of such structures results in linear systems of equations to be solved, which 
are desired to be solved iteratively by a fast, low storage requirement solver such as the Fast 
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Multipole Method or the pre-corrected FFT method. The use of an iterative solver requires that 
the condition number of the linear system (the ratio of the largest to smallest eigenvalue) be as 
close to one as possible. When the condition number is too large a preconditioner is used to 
condition the system and reduce the condition number. However, for such structures as those 
mentioned above, the use of common rooftop basis functions (also known as Rao-Wilton Glisson 
or RWG functions) produces linear systems with large condition numbers such that no known 
preconditioner has been available to properly condition the system. 

As was noted above, the most common attempt at a preconditioner is one based on geometrically 
close interactions. To form such a preconditioner, one sets to zero all interactions in the linear 
system that are geometrically separated by a defined distance. Such a preconditioner will only be 
effective, however, for structures that are large compared to the wavelength when the common 
rooftop or RWG basis functions are used. One existing solution to this problem uses less 
desirable loop-tree or loop-star basis functions which result in a better conditioned linear system. 
A disadvantage of this approach, however, is that the fast solvers mentioned above have 
difficulties dealing with the often large loops produced by the change in the basis functions. This 
is due to the inaccurate calculation of near interactions by the fast solver, for which large loops 
have many. Reference can be made to "Fast and efficient algorithms in electromagnetics", by 
Weng Chew et al., Artech House 2001, for descriptions of fast solvers and loop-tree or loop-star 
basis functions. 
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SUMMARY OF THE PREFERRED EMBODIMENTS 



The foregoing and other problems are overcome, and other advantages are realized, in accordance 
with the presently preferred embodiments of these teachings. 

Disclosed is a preconditioning method for the solution of linear systems based on physical systems, 
where unknown basis functions are supported by at least two mesh elements. To generate the 
preconditioner, the physical system is partitioned into regions with a small number of unknown 
elements per region. The preconditioner is represented by those elements of the linear system's 
coefficient matrix representing interactions between physical elements in the same regions only. 

To avoid the use of any form of incomplete LU, which produces inadequate results, a specialized 
method of applying the preconditioner is also disclosed. The preconditioning technique can be 
applied to any iterative solver, such as conjugate gradient (CG) or the method of geometric residuals 
(GemRes) and to any type of numerical solver, such as the method of moments (MoM) or the finite 
element method (FEM). The preconditioning technique effectively lowers the condition number of 
ill conditioned linear systems previously thought to be unsolvable in their native form due to their 
large condition number. 

Disclosed is a method, a computer program and a system to partition the mesh of a physical system 
into regions to produce a preconditioner compatible with linear systems of equations having 
basis/interpolation function support over at least two mesh elements. Coupling of the preconditioner 
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between regions or partitions is only through the basis functions on the partition boundaries, which 
produces a preconditioner that is itself a valid solution to the same set of physical equations 
governing the full linear system. In this way the preconditioner is ideally suited for application to 
systems with poor condition numbers. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other aspects of these teachings are made more evident in the following Detailed 
Description of the Preferred Embodiments, when read in conjunction with the attached Drawing 
Figures, wherein: 

Fig. 1 is a schematic drawing of a method to provide the solution of a physical system. 

Fig. 2 is a depiction of the splitting of a mesh into regions or partitions for preconditioning. 

Fig. 3 illustrates two reduced coupling partitions having a partition boundary and shows, for a non- 
limiting example of an application of this invention, three types of currents (interior, across a 
boundary and along the boundary). 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The preconditioning operation in accordance with this invention applies to any coefficient matrix, 
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dense or sparse, based on the solutions of a physical problem of unknown functions, commonly 
referred to as basis or interpolation functions, where the basis function spans more then one mesh 
element. Examples of such linear systems may result from, but are not restricted to, an 
electromagnetic analysis of printed circuit boards or field scattering in radar applications, fluid 
mechanics and acoustics using solution techniques such as the method of moments (MoM) or the 
finite element method (FEM). References for both methods can be found in R. Harrington's Field 
Computation by Moment Method,Krieger Publishing (1968) and J. Jin's The Finite Element Method 
in Electromagnetics, John Wiley & Sons Inc. (2002), respectively. 

Fig. 1 shows various operations for solving a linear system of equations based on the presently 
preferred method of preconditioning, that in turn is based on reduced coupling. Fig. 1 may also be 
viewed as representing a block diagram of a computational system that generates and uses the 
preconditioner in accordance with this invention. Fig 1 may also be viewed as a logic flow diagram 
that illustrates the operation of a computer program having program instructions that are executable 
by at least one digital processing apparatus, and that is stored in a machine-readable medium, such as 
in memory chips, a disk, a tape, or any suitable computer program instruction storage media. 

A presently preferred, but not exclusive, method of reduced coupling is described by B . Rubin et al. 
in "Electrical modeling of extremely large packages", Proceedings of Electronic Components and 
Technology Conference, 1997, the content of which is incorporated by reference herein. 



YOR920040053US1 



7 



In accordance with an aspect of this invention the reduced coupling is applied as a preconditioner to 
solve linear systems, and in accordance with a further aspect of the invention the preconditioner may 
be applied to a wider range of problem types than conventional approaches. 

In the method of Fig. 1 a description 10 of a physical structure of interest is divided by a mesh 
generator 20 into smaller elements, potentially numbering anywhere from thousands to millions. The 
union of these elements is commonly referred to as the "mesh" (see Fig. 2). In the MoM approach, 
commonly used to solve integral equations, unknown vector functions are described by 
mathematically known functions called basis functions that are supported over adjacent mesh 
elements. In the FEM approach, commonly used to solve differential equations, basis functions are 
associated with the mesh vertices and are defined over all mesh elements using that vertex. The mesh 
is used to compute the matrix A of coefficients for the linear system in block 30 by computing the 
interaction between the simple functions defined over all of these sets of mesh elements. 

A preconditioning matrix K is computed by first splitting or partitioning the mesh 20A that is output 
from mesh generator 20 into independent regions using mesh splitting function 40, with each region 
or partition containing many elements. Fig. 2 depicts an example of a physical mesh 20A split into 
five distinct partitions 21 A, 21B, 21C, 21D and 21E, collectively referred to as partitions 21. The 
partition boundaries are constrained to coincide with the edges of mesh elements. In other words, the 
mesh elements may start and end on the partition boundaries but may not cross the boundaries. 
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The preconditioner is implemented in block 50 by computing mesh element interactions using 
reduced coupling. The interactions between basis functions are computed only for those "half 
functions within the same preconditioning partition 2 1 . Here a "half ' denotes the function over any 
one of the multiple mesh elements for which it is defined. The interactions of basis functions 
crossing a partition boundary, labeled boundary elements, are computed separately for each of the 
halves. That means that no interactions exist between basis function halves that are defined in 
separate ones of the partitions 21 . Those basis functions completely within a partition 21, labeled 
interior elements, interact only with other interior elements and boundary element halves in the same 
partition 21 . In this way, interactions in the preconditioning matrix K between interior elements in 
the same partition 21 are equivalent to the interactions in the original matrix^, interactions between 
boundary elements and interior/boundary elements in the same partition(s) are different than the 
corresponding interactions in A. This is true due to neglecting some of the coupling between basis 
functions, and assuming that interactions between elements in different partitions are zero. 

It is important to note that, unlike zeroing out interactions based on geometric radius, as discussed 
previously, the resulting preconditioning matrix is a valid solution to the original physical set of 
equations. More specifically, it is the superposition of several solutions, one for each region. In this 
way it is ideally suited for preconditioning the matrix of the original system. 

In accordance with the foregoing technique, the indices of the basis functions in the matrices^ and AT 
are sorted so that all internal elements appear first, grouped according to their respective regions, 
followed by all boundary elements. The resulting preconditioning matrix K for a geometry with n 
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partitions 21 is computed in block 50 and is of the form: 



\ Ka A 



[Ka 2 ] 



[Kb] 



0) 



[Kc] 



[Kd] 



where the sub matrix Ka is the block diagonal matrix created by the union of the matrices of internal 
element interactions Ka\ through Ka n , Kd represents the interactions between the boundary elements, 
and Kb mdKc are the interactions between the internal and boundary elements. In general, Kb and 
Kc are not square, and are sparse since each column/row contains interactions between one boundary 
element and the internal elements to the two regions sharing that boundary. The matrix Kd is square, 
with dimension equal to the total number of boundary elements, and is sparse, although its complete 
LU factorization will in general be dense. 

In order to solve the system of equations Ax=f 'implied by the mesh generator 20, the linear system 
matrix A from block 30, a vector / of the boundary conditions on each element from block 60, and 
the preconditioner function K from block 50 are combined in an iterative solver 70. The resulting 
output of the iterative solver 70 is the approximate solution x. The operation of the iterative solver 
70, for example CG, with the preconditioner function K proceeds as follows: 

A trial solution Xo is selected. Vectors r 0 and P 0 are defined as r 0 =f-Ax 0 and P 0 =IC l r 0 . The following 
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steps are then performed iteratively until convergence is achieved: 
O f =(iTV M ,r H )/(p H> 4p M ) 

where the expression in the form of (x,y) represents the scalar product of the vectors x andy. 

The application of the preconditioner function K requires the product w=K x v, where v and w are 
vectors. Since the inverse JT 1 would have a larger ratio of nonzero elements then K, this is 
performed by solving the system Kw=v. This is done by noting the division of K, w, and v into their 
internal and boundary elements: 







Ka 


Kb 




_ V bnd . 




Kc 


Kd 


. W bnd. 



Using linear algebra operations, the solution for the boundary elements w bnd can be expressed as the 
solution of 

[Kd -KcKa~ l Kb]w hn6 = v bnd -KcKa\ t . (3) 

This requires only the LU factorization of the block diagonal matrix Ka and the factorization of the 
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matrix [Kd-KcKa l Kb] , which is of dimension equal to the total number of boundary elements and 

is typically extremely small compared to the total number of current elements. The solution of the 
internal elements w mt is then 

w m =Ka\ mX -Ka l Kbw bnd . (4) 

The solution time for this linear system is dominated by the LU factorization of the block diagonal 
matrix Ka 9 and assuming a constant number of unknowns per partition for simplicity, is 
O (^ p artitions^eiements_per_paitition ) • Additionally, if the number of unknowns per partition is held fixed, and 
the size of the problem is increased, thus increasing the number of partitions, then the CPU time and 
storage requirements grow as O(N), even for an originally dense matrix A. 

To perform as much upfront computation as possible before starting the CG, the LU factorizations of 
Ka and ^Kd -KcKa A Kb^ are preferably taken prior to starting the iterations. The traditional back 

substitution at each iteration is replaced with a combination of the back substitutions of the stored 
LU factorization of Ka, which is done as independent back substitutions on each block of Ka for 
maximum efficiency, two matrix- vector multiplications with the sparse matrixes Kb and Kc, and a 
back substitution on the matrix [ Kd - KcKa' l Kb^ , which is dense but small in dimension. The time 

spent preconditioning the system is dominated by the back substitutions, but the required CPU time 
is O(N). 
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Based on the foregoing description it can be appreciated that the preconditioner 50 partitions the 
description of the physical structure or entity, actually the mesh representation of the physical 
structure or entity, into isolated regions. Coupling between the regions or partitions exists only in the 
form of basis functions which cross the partition boundaries. The result is a preconditioner function 
^that is a superposition of smaller, valid solutions of the original set of governing equations. For 
this reason, it is applicable to linear systems with extremely poor condition numbers (>10 u ). The 
storage requirements of the preconditioner 50 are sparse, and require but 0(N) operations (O) per 
iteration to apply, where N is the dimension of the original linear system. 

Discussed now is an application of the foregoing teachings to a specific, non-limiting class of 
problems, where the preconditioner 50 allows full wave linear systems of both electrically small and 
large geometries, with rooftop or RWG basis functions, to be properly preconditioned. 

As was discussed above, the preconditioner 50 is based on the reduced coupling structure concept, 
the details of which can be found in "Electrical modeling of extremely large packages" by B. Rubin 
et al., in the Proceedings of the Electronic Components and Technology Conference 1997. 

As was also discussed above, the original structure is partitioned into at least two smaller structures, 
as shown in Fig. 2. Assume for this case that the original structure represents a signal line embodied 
as a thick conductive loop 23. It is assumed that full electromagnetic coupling exists between electric 
and magnetic currents within each partition 21, and that the electric and magnetic currents do not 
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couple with other currents outside of their respective partition 21. Current flow is enforced to be 
continuous across the boundaries of all partitions 21 . The matrix for the linear system that results 
from this analysis of the partitioned structure, labeled as the reduced coupling system matrix, is the 
preconditioner for the original structure. The preconditioner and the necessary LU factorizations are 
sparse, so that the storage requirements are small and the application is fast. 

Linear systems to be preconditioned may include the system of the original structure, such as the 
thick conductive loop 23, or a reduced coupling system composed of larger partitions than the 
preconditioner. Although the preconditioner removes the requirement of loop-tree or loop-star basis 
functions, it could also be applied to condition linear systems composed from these basis functions 
as well. 

The generation of the partitions 21 could be automated, as shown in Fig. 1 at block 40. A simple 
example of automated partitions is to divide the structure into sections along each of the three 
coordinate axis, generating a grid of boxes that partition the structure. 

In accordance with this invention the original structure is partitioned into at least two smaller 
structures, and those mesh cells that cross a partition boundary are split so that they start and stop on 
the partition boundary. In this way all mesh cells are located completely within one partition 21 . A 
basic strategy for implementing the reduced coupling is to compute the basis/testing function (also 
known as an expansion/weighting function) interactions by treating each 'half of the basis and 
testing functions independently. Here a 'half denotes the function over one of its two mesh cells. 
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Each half basis is assumed to radiate electric/magnetic field only within the same partition, and thus 
interacts only with half testing functions within the same partition. Testing functions crossing a 
partition boundary, labeled boundary elements, are tested separately for the two halves. The half of 
the testing function in each partition tests only the field from basis functions in that partition. If the 
basis function in question is a boundary element, then only the half of the basis in that partition is 
tested. This also applies to the self terms, or diagonal terms, of the matrix. Testing functions located 
completely within a partition, labeled interior elements, operate to test the electric field from other 
interior elements and halves of boundary elements in the same partition. By forcing both halves of a 
boundary element to share the same coefficient in the linear system solution, the conduction current 
is continuous across boundaries if the partitions 21. 

To illustrate the foregoing principles, Fig. 3 shows two partitions A and B for which the electric 
and/or magnetic current is the solution desired, labeled current elements, that exist within the 
partitions. The example current elements I^t, Ibnd and Itan (I internal, boundary and tangent, 
respectively, as shown in Fig. 3) are given to illustrate the three possible types of basis/testing 
functions. 

The type of current is defined by the location relative to the partition boundaries. The current element 
Ibnd represents a basis/testing function whose functional support crosses the boundary between the 
two partitions labeled A and B. When formulating the linear system matrix, the half of I bnd within 
partition A is tested over all of the testing function completely contained within partition A, and any 
halves of the testing functions from other boundary elements within A. The half of I bn d within 
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partition B does not radiate into A, and thus its contribution is not tested within partition A. The 
reverse applies to the half of I bn d within partition B. Even the self term, or diagonal element, of the 
matrix does not contain interactions between the two halves of I bn d. Both halves of the boundary 
element are given the same coefficient in the linear system solution, thus current is forced to be 
continuous across the boundary between the partitions A and B 

The current element I^t represents a basis function whose support is complete contained within a 
single partition 21 . The current I^t is tested over all testing functions located completely within the 
same partition, as well as the halves of the boundary elements within the partition. All other 
interactions with I^t are zero. 

The current element Itan represents a basis/testing function whose support lies directly on, and does 
not cross, a partition boundary. The partition to which Itan belongs is thus undefined. In this case 1^ 
is either assumed to be an internal element to one of the two partitions, or duplicated to produce two 
internal current elements, each internal to one of the two partitions that share the boundary. 
Duplication appears to provide superior performance. If only half of the basis/testing function is 
tangent to the boundary, then the other half must be internal to one partition, and Itan is treated as in 
internal element to this partition only. 

The indices of the basis/testing functions in the linear system are sorted so that all internal elements 
appear grouped according to their respective partitions, and boundary elements are grouped. The 
resulting linear system matrix for a geometry of n partitions then takes the form shown above in Eq. 
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(1), the use of the preconditioner 50 proceeds as was discussed above. 

It should be noted that there are at least two issues that are not obvious in the above-cited Rubin et al. 
publication that are believed to inhibit the disclosed technique from being most effectively used as a 
preconditioner. The first is that the diagonal elements of the matrix corresponding to the boundary 
elements are different in the reduced coupling system and in the original linear system. This is not 
the case for other preconditioning schemes, and would not be intuitive when implementing a 
preconditioner. The reason for this difference, as mentioned above, is that, unlike internal elements, 
the two halves of the boundary element do not couple with each other since they are located in 
separate partitions. If this detail is ignored, the reduced coupling preconditioner will be less 
effective. 

The second issue relates to the fact that only those current elements that cross a partition boundary 
can be treated as boundary elements. While it might intuitively appear that the more coupling that is 
included in the preconditioner the better, this is not true in this case. Treating elements that are 
otherwise internal to a partition as boundary elements, by allowing them to couple to more than one 
partition, will result in a preconditioner that is less effective. Basically, the structure of the coupling 
as described above should be adhered to, or the preconditioner will be less effective. 

The foregoing description has provided by way of exemplary and non-limiting embodiments a full 
and informative description of the best method and apparatus presently contemplated by the 
inventors for carrying out the invention based on the current knowledge of the inventors. However, 
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various modifications and adaptations may become apparent to those skilled in the relevant arts in 
view of the foregoing description, when read in conjunction with the accompanying drawings and the 
appended claims. As but some examples, the use of other similar or equivalent iterative solvers 70, 
the use of sparse storage methods on the components of the preeonditioner, the use of alternate mesh 
elements or expansion/interpolation functions, considering the elements of any two adjacent or 
nonadjacent partitions to belong to a single larger partition, and the use of this invention for other 
applications (other than to solve current flow in electrical conductors) may be attempted by those 
skilled in the art. However, all such and similar modifications of the teachings of this invention will 
still fall within the scope of this invention. 

Furthermore, some of the features of the present invention could be used to advantage without the 
corresponding use of other features. As such, the foregoing description should be considered as 
merely illustrative of the principles of the present invention, and not in limitation thereof. 
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